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Abstract 

We study theoretical constraints on the parameter space under the conditions from vacuum sta- 
bihty and triviahty in the three-loop radiative seesaw model with TeV-scale right-handed neutrinos 
which are odd under the Z2 parity. In this model, some of the neutrino Yukawa coupling constants 
can be of the order of one. Requirement of strongly first order phase transition for successful 
electroweak baryogenesis also prefers order-one coupling constants in the scalar sector. Hence, it is 
important to clarify whether this model satisfies those theoretical conditions up to a given cutoff 
scale. It is found that the model can be consistent up to the scale above 10 TeV in the parameter 
region where the neutrino data, the lepton flavor violation data, the thermal relic abundance of 
dark matter as well as the requirement from the strongly first order phase transition are satisfied. 
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I. INTRODUCTION 



The Higgs sector is the last unknown part in the standard model (SM). There is no 
compelling reason that it takes its minimal form. Instead, there can be various possibilities 
for non-minimal Higgs sectors. Currently, searches for the Higgs boson is underway at the 
Tevatron and the Large Hadron Collider (LHC). It is expected that crucial information for 
the Higgs sector will be obtained in near future. On the other hand, there are phenomena 
which cannot explain within the SM such as neutrino oscillation, existence of dark matter, 
and baryon asymmetry of the Universe. They provide us strong motivations to consider 
physics beyond the SM. 

The Higgs sector may be related to the physics to cause these phenomena. First of all, 
based on the WIMP (Weakly Interacting Massive Particle) hypothesis, the observed value of 
the relic abundance requires the mass of the dark matter to be around the electroweak scale. 
Why is the mass of the WIMP dark matter at the electroweak scale? This would strongly 
indicate a di.ect co,.ect,o„ between the WIMP da., n^atte. and tKe H„g. .eeto. flff 
Second, the origin of neutrino masses may also be the TeV scale: i.e., the origin of the 
lepton number violation would be the existence of TeV-scale right-handed neutrinos or that 
of lepton number violating scalar interactions in the extended Higgs sector. As a natural 
scenario for generating tiny neutrino masses, such lepton number violation at the TeV scale 
would be transmitted to the left-handed neutrino sector via loop effects of the Higgs sectors. 
This is so-called the radiative seesaw scenario js-?]. Finally, a simple description of baryon 
asymmetry of the Universe may be the scenario in which electroweak phase transition is of 
strongly first order in order to satisfy the Sakharov's condition of departure from thermal 
equilibrium js]. This is the scenario of electroweak baryogenesis 

An attractive point for these scenarios would be that they can give definite predictions 
to TeV-scale phenomenology, so that we can directly test them by experiments, in principle. 
Various scenarios for the WIMP dark matter can be tested by direct and indirect searches as 



well as collider experiments 



a 



10|. Each radiative seesaw model predicts a characteristic 



extended Higgs sector with lepton number violating interactions [3|, 14, Illl-ll3| or right-handed 
16| . It is known that the dynamics for the electroweak baryogenesis 



neutrinos 5, 



01 



strongly related to the Higgs boson phenomenology at colliders jl7l |. 

Therefore, an interesting question is whether or not we can construct a successful TeV- 
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scale phenomenological model where these three phenomena would be explained simultane- 
ously. Recently a TeV-scale model has been proposed for such a purpose I?], in which 1) 
tiny neutrino masses are generated without excessive fine tuning at the three-loop level by 
the dynamics of an extended Higgs sector and right-handed neutrinos under an unbroken Z2 
parity, 2) the Z2 parity also guaranties the stability of a dark matter candidate which is a 
odd scalar boson, and 3) the strongly first order phase transition for successful electroweak 
baryogenesis can be realized by the non-decoupling effect in the Higgs sector. Phenomenol- 
ogy of this model has been^ discussed in Ref. jl8|, and the related collider physics 19-21| 
and dark matter properties [22;| have also been studied. In these papers, phenomenologically 
allowed parameter regions have been mainly discussed. 

In this paper, we investigate the theoretical constraint on the parameter regions in this 
model ~\ from the requirement of vacuum stability and perturbativity up to a given cutoff 



scale A of the model 



23| . In the present model, there is no mechanism for cancellation 



of the quadratic divergences which appear in the renormalization calculation for the Higgs 
boson mass, so that a huge fine tuning is required if A is much higher than the electroweak 
scale. To avoid such an unnatural situation, we need to consider A to be at most (9(10) TeV, 

n 

above which the model would be replaced by a more fundamental theory [24|. Hence, we 
have to study the theoretical consistency of the model up to such values for A. In particular, 
some of the neutrino Yukawa coupling constants are of order one in magnitude, as the scale 
of tiny neutrino masses is generated by loop dynamics so that we do not need fine tuning 
for the size of the coupling constants. In addition, some of the coupling constants in the 
Higgs potential are of order one to realize the non-decoupling one-loop effect for strongly 
first order phase transition. Although the parameters discussed in the previous works satisfy 
the bound from tree-level unitarity 25|, it is non-trivial that the model can be consistent 
at the quantum level with the theoretical requirements up to A ~ 10 TeV. Theoretical 
bounds from vacuum stability and perturbativity have been used to constrain parameters 
in extended Higgs sectors such as the two Higgs doublet model 26| and the Zee model 11 |. 
Here we apply the similar analysis to the model. We prepare a full set of the renormalization 
group equations (RGEs) for dimensionless coupling constants in the model at the one-loop 
level, and analyze the behavior of running coupling constants. 

We also revise the phenomenological constraint from lepton fiavor violation (LFV) in the 
model. In the previous analysis j3, Q only the constraint from /x — )■ 67 data has been taken 
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into account. Here, we also analyze the one- loop induced fi — )■ eee process, whose current 



experimental data j27| turn out to give a stronger bound on the parameter space than those 

of /i ^ 67 

The paper is organized as follows. In Sec. II, we give a brief review of the model. In 
Sec. Ill, we introduce the criteria for vacuum stability and triviality, and numerical results 
of the RGE analysis are presented. In Sec. IV, we give a conclusion. 

II. THE THREE-LOOP NEUTRINO MASS MODEL 

We give a short review for the the three-loop neutrino mass model in Ref. Q to make 
the paper self-contained. 

A. Model 

In this model, two Higgs doublets ($i and $2) with hypercharge Y = 1/2, charged scalar 
singlets (5*^), a real scalar singlet [rj) and right-handed neutrinos {N^ with a = 1,2) are 
introduced. We impose two kinds of discrete symmetries; i.e., Z2 and Z2 to the model. The 
former, which is exact, is introduced in order to forbid the tree-level Dirac neutrino mass 
term and at the same time to guarantee the stability of dark matter. The latter one, which 
is softly broken, is introduced to avoid the tree-level flavor changing neutral current 
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Under the Z2 symmetry there are four types of Yukawa interactions 
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so-called the type-X Yukawa interaction 19|, l32| is favored since the charged Higgs boson 



31| . In our model [7| , 



from the two doublets can be taken to be as light as around 100 GeV without contradicting 
the 6 — )■ 57 data. Such a light charged Higgs boson is important to reproduce the correct 
magnitude of neutrino masses. The particle properties under the discrete symmetries are 
shown in Tabled where Q^, rf^j, L}^ and are the i-th generation of the left-handed 
quark doublet, the right-handed up-type quark singlet, the left-handed lepton doublet and 
the right-handed charged lepton singlet, respectively. 



^ We thank Torn Goto for telling us the possibility of a sizable contribution to the branching ratio of 
^ — >■ eee in our model. 
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Ql Ur dji 






^2 (exact) 


+ + + + + 


+ + 




^2 (softly broken) 


+ - - + + 


+ - 


+ - + 



TABLE I: Particle properties under the discrete symmetries. 



The type-X Yukawa interaction is given by 



>CXa = - E mYi^^dn) + {QIY^^^'r) + (LiY^^ie^)] + h.c, (1) 



where Yukawa coupling matrix for leptons is diagonal, — diag(yei, ye2, Z/es)- The mass 



term and the Yukawa interaction for are written as 

3 2 



a=l i=l a=l 



(2) 



The scalar potential is given by 



y = + Ai?|$i|' + A^^|$2|' 



l4^{^2 + h.c. 



+ ^Ai|$i|^ + ^A2|$2|' + A3|$in$2r + A4|$l$2|' + I U5($l$2)' + h.C. 



1 



2 

+ E Y^ah^^'c^'^^hS-y] + h.C 

a,fe=l 



(3) 



where are anti-symmetric matrices with £12 = 1. The parameters A5, and k are 
complex numbers. Two of their phases can be absorbed by rephasing the fields, and the 
rest is a physical one. In this paper, we neglect this CP-violating phase for simphcity. The 
Higgs doublets are parameterized as 



+ 



-^{hi + Vi + iz^ 



(4) 



where Vi are vacuum expectation values (VEVs) of the Higgs fields, and these are constrained 
by y/vj + vfj ~ 246 GeV. The ratio of the two VEVs is defined by tan ^ = vijvx. The 
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physical scalar states h, H, A and in the Z2 even sector can be obtained mixing angles 
a and /3, 





where and z are the Nambu-Goldstone bosons absorbed by the longitudinal weak gauge 
bosons, and the rotation matrix with the angle 6 is given by 

(cos 6* — sin 6* \ 
(6) 
sin 6 cos 6 I 

The mass formulae of physical scalar states are given by 



m 



2^ _ i\j2 „,2 



- v'X„ (7) 

m^± = M2-y(A4 + A5), (8) 

mjj = cos^(a - /3)Mii + 2 sin(a - /3) cos(a - l3)M^2 + sin^(" - l3)M22, (9) 

ml = sin2(a - l3)M^^ - 2 sin(a - /3) cos(a - l3)M^2 + cos^(a - /3)M225 (10) 

"^5 = /"I + yPicos^/^ + YP2sin2/3, (11) 

"^1 = f^l + y^i cos^ (3 + —a2 sin^ /3, (12) 



where M(= yUa/A/sin /3 cos /3) is the soft breaking scale for the Z2 symmetry, and 

Ml^ = v\Xi cos^ /3 + X2 sin^ /3) + —A sin^ 2/3, (13) 

2 

= + sin2 /3 cos^ /3(Ai + A2 - 2A), (14) 

= w^sin/3cos/3(-Aicos^/3 + A2sin2/3 + Acos2/3), (15) 

with A = A3 + A4 + A5. Notice that M, /xg and /i^ are free mass parameters irrelevant to the 
electroweak symmetry breaking. 

B. Neutrino mass and mixing 

The neutrino mass matrix M^j is generated by the three- loop diagrams in FIG. [1] The 
absence of lower order loop contributions is guaranteed by the Z2 symmetry. The resulting 
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FIG. 1: The Feynman diagrams for generating tiny neutrino masses. 



mass matrix is calculated as 

2 



M^. = J]4K2tan2/3(|/SM/,-)(|/SM;,«)^(^^^^^^^^^^^^^)^ (16) 



a=l 



where the loop integral function F is given by 



F{mH±,ms,mN,mn) 



X xdx{Bi{-x,mH±,ms) - Bi{-x,0,ms)} — ■ ^ ■ ^ , (17) 

Jo \x + mjf x + m^J 

with yf^ = \/2miJv, where ii, £2 and £3 correspond to e, /i and r, respectively. The function 
Bi is the tensor coefficient in the formalism by Passarino-Veltman for one- loop integrals 33 1. 
In the following discussion, we take ^atj^ = = ^Nr-, for simplicity. Numerically, the 
magnitude of the function F is of order 10^ eV in the wide range of parameter regions of our 
interest. Since < 10~^, the correct scale of neutrino masses can be naturally obtained 
from the three-loop diagrams. 

The generated mass matrix in Eq. ( IT6|l of neutrinos can be related to the neutrino 
oscillation data by 

M^^ = U.s{Ml,,^),,{U^),,, (18) 

where M^^^^ = diag(mi, m2, ms). For the case of the normal hierarchy we identify the mass 
eigenvalues as mi = 0, m2 = a/AtttJ^, = a/ Am^^m) while for inverted hierarchy 
mi = \/ Amatm; ^2 = \J Amatm + '^"^soiar ^^"^ ^3 = ^'^^ taken. The Maki-Nakagawa- 
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FIG. 2: The LFV processes. 



Sakata matrix Uis 3^ is parameterized as 



U 











^13 









•^12 


■^12 







1 










"^23 







1 







"■^12 


•^12 















"""523 


^23 




■'13^ 





Cl3 










1 













(19) 



where Sij and Cij represent sin^jj and cos 9ij, respectively, with 9ij to be the neutrino mixing 
angle between the ith and jth generations, and 6 is the Dirac phase while a and /3 are 
Majorana phases. For simplicity, we neglect the effects of these CP violating pha ses in the 
following analysis. Current neutrino oscillation data give the following values |35|]; 



Am, 



solar 



7.59 X 10"^ eV- 



\Ami,J ~ 2.43 X IQ-' eV' 



sin^ 012 ^ 0.32 , sin^ 



23 



0.5 



sin^ < 0.04 . 



(20) 
(21) 



In the next subsection, we discuss parameter regions in which both neutrino data and 
the LFV data are satisfied. 



C. Lepton flavor violation 

The model receives the severe constraints from the lepton-flavor violating processes of 
/i — )■ 67 and /i — )■ eee: see Fig. [2j These processes are induced through one-loop diagrams 
by N'^ and S'^ with the Yukawa couplings hf {i = e and /x). The branching ratio of /x — )■ 67 
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is given by 



B{fi 67) 



327rm| 



a=l 



mt 



(22) 



where ^2(0;) = (1 — 6a; + 3x^ + 2x^ — Qx^ lnx)/6(l — xY- For — )■ eee, the branching ratio 
is calculated by 

2 



B{n ^ eee) 



16GI 



m 



X 



R 



+ m 



2 2 

m^g — m p 



log- 



167r2 



a,/3=l 



m|)(m^ 



57 



mm 



+ 



log ^ + 



7V^ 



+ m 



R 



s 



R 



m o — ma 

K ^ 



^ log + 1 



m^0 



R 



In particular, when m^^i 



m^Vfl), the expression in Eq. (123!) is reduced to 



(23) 



i?(/i — )■ eee) 



1 



167r2 



ml^ - ml 



m 



m%^ - m| 



log 



+ 1 



(24) 



Assuming that /ig ~ C^(l), the masses of A^^^^ and are strongly constrained from 
below. In particular, if we assume that ms > 400 GeV, m^^ > 0(1) TeV is required to 
satisfy the current experimental bounds, i?(/i — )■ e^) < 1.2 x 10^^^ [28| and i?(/i — )■ eee) < 
1.0 X 10^^^ 1271. Such a relatively heavier is favored from the discussion on the dark 

pn 

matter relic abundance and electroweak baryogenesis [3, [ISj] . 



D. Typical scenarios 

In Table [Tll we show four choices for the parameter sets, and resulting values for the 
neutrino Yukawa coupling constants h°' which satisfy the neutrino data and the LFV data. 
For all parameter sets, ms = 400 GeV and mjv^ = 5 TeV are assumed. Set A and Set B are 
taken as the normal hierarchy in the neutrino masses with sin^ 613 = and 0.03, respectively, 
while Set C and Set D are for the inverted hierarchy. The predictions on i?(yU — )■ e'j) and 
B{fi ^ eee) are also shown in the table'^. The scenario with the inverted hierarchy requires 



^ The formula of Eq. ([22|) is different from Eq.(31) in Ref. 18] which includes errors. We have recalculated 
the values of B{fi — > 67) by using the corrected formula and checked that the values of 67) in the 



parameter sets in Table II in Ref. 18| are still below the experimental bound. 

In Table HIl we show the numbers of the hf coupling constants with four digits for Set C, because the 
branching ratios of /i — > 67 and fj, — >■ eee are sensitive to these numbers due to large cancellations. 



9 



bet 


Inputs 


Yukawa couplings 


LFV 




&m (7X3 




"-e 


"-e 












u \ jLX roc 1 


A 

A 


n 
U 


04 


i.Z 


1 Q 
i.O 


n no/i 
U.Uz4 


-U.Uii 


U.UUU i 


-U.UUi4 


z.o X iU 


r n , , -1 r\— 13 

o.y X iu 




0.03 


76 


1.1 


1.1 


0.0028 


0.018 


-0.00055 


0.00097 


6.1x10"^^ 


7.4x10"^^ 


c 





80 


3.500 


3.474 


0.01200 


-0.01192 


-0.0007136 


0.0007086 


4.4x10-1'^ 


6.2x10-1^ 


D 


0.03 


128 


2.1 


2.2 


0.0064 


-0.0086 


-0.00053 


0.00035 


3.5x10^15 


7.0x10-13 



TABLE II: Values of /if as well as those of branching ratios of /i — )• 67 and — )• 3e for = 50 
GeV and 'fn^^^ = 100 GeV for various scenarios which satisfy neutrino data: Set A and Set B are 
scenarios of the the normal hierarchy while Set C and Set D are those of the inverted hierarchy. 
For all sets, mg = 400 GeV and mAr^ = 5 TeV are taken. 

the larger values for fi;tan/3, so that the normal hierarchy scenarios are more natural in our 
model. 

In Fig. [3l the contour plots of the branching ratio B{fi ^ 67) are shown in the rrig- 
rriN^ plane for the neutrino Yukawa coupling constants in Set A to Set D, while those of 
the branching ratio eee) are shown for these scenarios in Fig. HI The scale of the 

branching ratio of /i — )■ 67 is determined by itlnji and is insensitive to ms, while that of 
/i — > eee largely depend on both m^v^ and ms especially for Set A, Set B and Set D. It can 
easily be seen that a much stronger constraint comes from /j, eee for all scenarios. 



E. Dark matter and electrovifeak phase transition 

From now on, we employ Set A in Table HTl for further phenomenological analyses. In this 
scenario, masses of are at the multi-TeV scale, so that it may be natural that the rest Z2- 
odd neutral field t] is the candidate of dark matter. Since 77 is a singlet under the SM gauge 
group, the interactions with Z2-even particles are only through the Higgs coupling. When 
rrir) < mw, the 7] field predominantly annihilates into bb and r+r^ through s-channel Higgs 
boson {h and H) mediations. Strong annihilation occurs at ~ '^hI'^ (and ~ Tnh/2) 
due to the resonance of H {h) mediation in the s-channel diagrams. The pair annihilation 
into two photons through one-loop diagrams by and can also be important if k is of 



the order one. The rehc abundance becomes consistent with the data (^dm^^ ~ 0.11 |36l |) 
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FIG. 3: Contour plots for the branching ratio of /i — t- 67 for the neutrino Yukawa couphng constants 
in Set A (top-left), Set B (top-right), Set C (bottom-left) and Set D (bottom-right). The contour 
for the upper limit from the data is given as the (red) solid curve. 

for rriri ~ 50 — 60 GeV, when we take = ~ 100 GeV, ~ 120 GeV, > 400 
GeV with k = 1.5, ai = 0.05, (72 = 0.03, and tan/3 = 36. In such scenario, the typical 
spin-independent cross section for the scattering of dark matter with a proton is of order of 
10^^ pb which is within the reach of the direct search experiments such as superCDMS and 
XMASS. 

When rrifj < m/j/2, the (SM-like) Higgs boson h can decay into a dark matter pair 7777. 
The branching ratio of h ^ rji] is evaluated as 34 % (22 %) for rrih = 120 GeV and = 48 
(55) GeV when ai = 0.05, cr2 = 0.03 and tan/3 > 10. The invisible decay of h can be tested 



at the LHC when B{h rjr]) > 25 % 371]. At the ILCMt is expected that the branching 



ratio for the invisible decay of a few % can be detected 38|]. Therefore, the invisible decay 
in this model can be tested at the collider experiments. 
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FIG. 4: Contour plots for the branching ratio of /U — t- eee for the neutrino Yukawa couphng 
constants in Set A (top-left), Set B (top-right), Set C (bottom-left) and Set D (bottom-right). The 
contour for the upper limit from the data is given as the (red) solid curve. 

Our model [3] satisfies the conditions for baryogenesis js^. The B number violating 
interaction is the sphaleron interaction. The additional CP violating phases are in the Higgs 
sector and in the Yukawa interaction. The condition of departure from thermal equilibrium 
can be realized by the strong first order electroweak phase transition, which requires a 
large tri-linear coupling of the order parameter in the expression of the high temperature 
where only the bosonic loop can contribute^. In our model, there are many 



expansion 



additional scalars running in the loop so that the large coupling can be easily realized 



17|. 



The strong first order phase transition is possible for large rrig and/or with the large 



4 



We note that such a non-decouplin g et Fect due to the bosonic loop can also affect the quantum correction 



iplm g en 

to the triple Higgs boson coupling [171, |40| . Such a large correction to the Higgs self-coupling can be an 



important signature for successful electroweak baryogeneis at collider experiments. 
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non-decoupling effect: e.g. ~ 400 GeV, ~ 100 GeV, M = 100 GeV and /x^ = 200 
GeV, where M and fi^ are the invariant masses in Eq.© and Eq.( !TT|) . respectively. The 
result is not sensitive to tan /3. 



III. BOUNDS FROM TRIVIALITY AND VACUUM STABILITY 

There are scalar bosons in this model, so that quadratic divergences appear in the one- 
loop calculation for their masses. Because there is no mechanism by which such quadratic 
divergences are eliminated, enormous fine tuning is required to realize the renormalized 
Higgs boson mass being at the weak scale with a very high cutoff scale. Allowing the 1 % 
fine tuning, the cutoff scale is at most A ~ 0(10) TeV, above which the theory would 
be replaced by a more fundamental one Unless a mechanism of cancellation of the 

quadratic divergences such as supersymmetry is implemented, to avoid excessive fine tuning 
the model should be regarded as an effective theory, whose cutoff scale A is between ttin" and 



0(10) TeV. We then need to confirm the theoretical consistency of the model up to A [23 1. 
We here evaluate bounds on the parameter space from vacuum stability and perturbativity, 
and examine whether the theoretically allowed parameter region is consistent with that by 
the experimental data discussed in the previous sections. 

We have to consider these two bounds seriously because of the following reasons. First, 
this model includes many scalar fields, e.g., h, H, A, , and ?7, so that the scale depen- 
dent dimensionless coupling constants would be drastically changed by the loop corrections 
due to the scalar bosons. Second, some of the Yukawa coupling constants for right-handed 
neutrinos are necessarily of order one for a radiative generation of the tiny mass scale of 
the neutrinos at the three-loop level. Finally, to realize the first order electroweak phase 
transition, some of the scalar self-coupling constants has to be as large as of order one. 

In order to evaluate the vacuum stability bound and the triviality bound, we estimate 
the scale dependences of the dimensionless coupling constants by using the RGEs at the 
one-loop level. We have calculated the one-loop beta functions for all the coupling constants 
in this model. The full set of the beta functions is listed in Appendix. We take into account 
the threshold effects in the calculation of the scale dependent coupling constants. In the 
scale below the mass of 5*^, we treat the theory without Nr and 5*^. In the scale between 
the masses of the and Nr, we treat the theory without Nr. In the scale higher than the 
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mass of the Nr, we treat the theory with full particle contents. 



A. The conditions 

In this model, there are scalar fields (i = 1, 2), S*^ and rj, which contain eleven degrees 
of freedom which would share the order parameter. The four of them are eliminated because 
of the SU{2)l X f/(l)y gauge symmetry. In the remining seven dimensional parameter 
space, we require that for any direction the potential is bounded from below with keeping 
positiveness (41]. In the SM, this requirement is satisfied when the Higgs self-coupling 
constant is positive. In this model, we put the following conditions on the the dimensionless 
coupling constants: 

Ai(/i) > 0, A2(/i) > 0, Xsifi) > 0, XM > 0, (25) 



v/Ai(/i)A2(/x) + A3(/i) + MIN[0, (A4(/i) + A5(/i)), {X^ifi) - X.ifi))] > 0, 



^Xi{fi)Xs{fi)/2 + piifi) > 0, ^Ai(^)A^(^)/3 + ai(^) > 0, ^/XM^^M/^ + P2{f^) > 0, 
^A2(/i)A^(/i)/3 + (T2(/i)>0, y/A5(/i)A^(/i)/6 + e(/i)>0, (26) 

2Ai(/i) + 2A2(Ai) + 4A3(/i) + 4pi(/i) + 4p2(/i) + Xs{fi) + 4ai(/i) + 4a2(/i) 

+ ^A,(/i) +4e(/x) - 16V2\K{fi)\ > 0. (27) 

The conditions in Eqs. ( 125|) and (l26l) are obtained by the similar way as in Ref. while 
the last condition in Eq. f l27|) is derived such that the term with the coupling constant k in 
the potential satisfies the positivity condition for the direction where the VEVs of the fields 
$1, $2; and rj are a common value. 

We require that all the dimensionless running coupling constants do not blow up below 
A. Since we discuss the model within the scale where the perturbation calculation remains 
reliable, we here require that the running coupling constants do not exceed some critical 
value. In this paper, we impose the following criterion in the coupling constants in the 
Higgs potential Eq. (|3]) and the Yukawa interaction in Eqs. ([1]) and ([2]): 

|Ai(/i)|, |o-i(/i)|, |pi(Ai)|, |fi:(/i)|, |^(/i)|<87r, 

y^if,), y'M, y'M, m\f^) < 4vr. (28) 
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The similar critical value has been adopted in the analyses in the two Higgs dobulet 
model and in the Zee model 



B. Allowed regions in the parameter space 

In this section, we evaluate allowed regions in parameter space, which satisfy the condi- 
tions of triviality and vacuum stability for each fixed cutoff scale A. For the scenarios of 
the neutrino Yukawa coupling constants as well as the masses of right-handed neutrinos, we 
choose Set A in Table Ull We investigate the allowed regions in the ms-rriA plane, and the 
rest of the mass parameters in the scalar sector is fixed as shown in Teble lllli 

The initial values for the scalar coupling constants in the Higgs sector are shown in 
Table. IIVI We note that the initial value of A4, A5 and p2 are determined by given values for 
the masses of A and 5*^ using Eqs. ([7]), ([H]) and ffTT]) . The rest parameter ^ (the coupling 
constant for \S~\'^ri'^) is taken as ^ = 3 and 5. The results in the case with ^ = 3 is shown in 
Fig. Ofor K = 1.2 (left figure) and k = 1.5 (right figure), while those with ^ = 5 is in Fig. [6] 
for the same values of k. 

In Fig. [5l the shaded area in the figure is excluded due to the vacuum stability condition 
in Eq. ( !27l) . In this area, the condition is not satisfied already at the electroweak scale, so 
that the excluded region is independent of A. The vacuum stability bound become stronger 
for a larger value of k, although the area compatible with both theoretical conditions with 
A = 10 TeV still exists for k = 1.5. On the other hand, the bound from perturbativity 
depends on A. In Fig. [5l the contour plots for A = 6, 10 and 15 TeV, the scales where one 
of the coupling constants blows up and breaks the condition of perturbativity are shown for 
the case of ^ = 3 in the ms-rriA plane. We find that there is the parameter region which 
satisfies both the conditions of vacuum stability and perturbativity with the blow-up scale 
to be above A = 10 TeV. The area of the vicinity of ~ 400 GeV and < 350 GeV 
can also be consistent from the theoretical bounds. We stress that this parameter region is 
favored for phenomenologically successful scenarios for neutrino masses, relic abundance for 
the dark matter, and the strongly first order phase transition. 

The similar figures but with ^ = 5 are shown in Fig. |6l The contour plots are for A = 6, 
10, 12 and 14 TeV in the ms-mA plane. We find that there is the parameter region which 
satisfies both the conditions of vacuum stability and perturbativity with the blow-up scale 
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Masses (GeV) 


Inv. masses (GeV) 


m% 


niH 






M 






100 


100 


120 


50 


100 


200 


30 



TABLE III: Values for the scalar boson masses and the invariant mass parameters. 









Scalar couplin 


gs 










Xi{mz) 




A3(mz) 


K,{rns) tan P 


Piijns) 




ai{mz) 


(72 (mz) 


\{mz) 


sin(/3 — a) 


0.24 


0.24 


0.24 


54 


0.1 


2 


0.05 


0.05 


3 


1 



TABLE IV: Values for the scalar coupling constants and the mixing angles. 



to be above A = 10 TeV. The vacuum stability bound is more relaxed as compared to that 
for ^ = 3, while the bound from perturbatibity becomes rather strict. In the regions with 
ms < 400 GeV, the running coupling constants blow up earlier than the case with ^ = 3, 
because of the threshold effect at the scale /x = m^, above which the running of becomes 
enhanced by the loop contribution of S^. In the area of 300 GeV < ms < 400 GeV and 
ruA < 350 GeV, A can be above 10 TeV. 

IV. CONCLUSION 

We have discussed theoretical constraints on the parameter space under the conditions 
from vacuum stability and triviality in the three-loop radiative seesaw model with TeV- 
scale right-handed neutrinos which are odd under the Z2 parity. It has been found that 
the model can be consistent up to the scale above 10 TeV in the parameter region which 
satisfies the neutrino data, the LFV data, the thermal relic abundance of dark matter as 
well as the requrement from the strongly first order phase transiton. We also reanalyzed the 
constraint from the LFV data. The data from /i — > eee is found to be more severer than 
that from // — > ej. Our analysis here has been restricted in the case where the CP violation 
is neglected just for simplicity. The analysis for consistency with including the CP violating 
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FIG. 5: Contour plots for the scale where condition of perturbativity is broken are shown in the 
ms-mA plane in the case of (K,tan/3) = (1.2,45) (left figure), and {k, tan f3) = (1.5,36) (right 
figure). The region excluded by the vacuum stability condition is also shown as the shaded area. 
The constant ^ is taken to be 3 at the scale of ms- 
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FIG. 6: Contour plots for the scale where condition of perturbativity is broken are shown in the 
fns-f^A plane in the case of (K,tan/3) = (1.2,45) (left figure), and (K,tan/3) = (1.5,36) (right 
figure). The region excluded by the vacuum stability condition is also shown as the shaded area. 
The constant ^ is taken to be 5 at the scale of ms- 

phase, which is necessary for finally producing the observed asymmetry of baryon number 
at the electroweak phase transition, will be done in near future. 
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Appendix 



The full set of the beta functions for RGEs in the model in Ref. 
level by 

1 



a 



Pig') 

m) 

/3(Ai) 

/3(A2) 

/3(A3) 

/3(A4) 

/3(A5) 
/9(pi) 



1 



[-79.'] 



IGvr 
1 



^ [-3^1 
22 



167r2 
1 

167r2 
1 

16^ 
1 

167r2 
1 

1 



167r2 



167r2 



167r2 



167r2 
1 

167r2 



17/0 ^ 9 

5/0 9 o 3 o 



9o 15/o 5o 

^g Vr -—g yr + -yr 



is given at the one-loop 



(29) 
(30) 
(31) 
(32) 
(33) 
(34) 
(35) 



3 



/3 



12A^ + A\l 



9 



2\l + 2\l + 4A3A4 + 2pl + crl + -g- 



-Ayt + {^yl-9g'-Sg'')X^ 



12X1 + 4A3 + 2A^ 



9 



2A^ + 4A3A4 + 2pl + al + ^-g^ 



6 2 '2 , 3 '4 
19 g "r-g 



6 2 '2 I 3 /4 

-^gg +-^g 



(36) 



12y,^ - I2yt + {I2yl + 12^^ _ 9(^2 _ 3(7 

2A1A4 + 6A2A3 ' ^ , , ox2 



6A1A3 
9 



2A2A4 + 4A^ + 2A2 + 2A^ + 2pip2 + ^^1^2 + 4k 



(37) 

2 



+ 4^?^ + ^^/'^ - -/g' + (6y,^ + Qyl + 2y^ - 9/ - 3^'2)A3 
2(Ai + A2 + 4A3 + 2A4)A4 + 8A^ - Sk^ + 3^V^ 

+ [Qy^ + Qyl + - 9g^ - ^g^)\^ , 
2(Ai + A2 + 4A3 + 6A4)A5 + {Qyl + Qyl + 2|/2 _ <^g^ _ 3(7'2)A5 
6A1P1 + 4A3P2 + 2A4P2 + 2P1A5 + 4p? + aii + + 3^'^ 
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9 



+ {-^g'-\g' + 2Y,m' + H)Pi 



(38) 

(39) 
(40) 

(41) 



/3(P2) 



167r2 



6A2P2 + 4A3P1 + 2A4P1 + 2P2A5 + 4p^ + (72^ + + 3^ 



'4 



+ 



15 



9 



g^-%^ + 2Y,m' + ^yl + ^yl)p2 



(42) 
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/3(A5) 



167r2 



?l + 8pl + 5A| + 2e + 24g'* - Ug'^Xs 



i,3 oi,l3 



(43) 



167r2 
1 



6Ai(7i + (4A3 + 2A4)(72 + (7iA^ + 2piC + 16k' + (-^^' - ^^'' + 2y^)(7i] , 



/3((72) = 6A2(72 + (4A3 + 2A4)cri + (72A^ + 2^2^ + 16k 



- + 61/,' + 6yl)a, 



167r2 
1 

T67r2 



2" 2 

-2 I 2\ I Q\2 



K 



12{ai + a'^)+3X'^ + 6e 
2 As - 2A4 + 2^ + 2ai + 2a2 + 2pi + 2p2 + ^{KY 



167r2 



4pi(7i + 4p2(J2 + 2A5e + + 4f - 6^''e + 2 
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